IEEE TRANSACTIONS ON SMART GRID, SPECIAL ISSUE ON BIG DATA ANALYTICS FOR GRID MODERNIZATION Efficient Compression of PMU Data in WAMS

Widespread placement and high data sampling rate of current generation of Phasor Measurement Units (PMUs) in Wide Area Monitoring Systems (WAMS) result in huge amount of data to be analyzed and stored, making efficient storage of such data a priority. This paper presents a generalized compression technique that utilizes the inherent correlation within PMU data by exploiting both spatial and temporal redundancies. A two stage compression algorithm is proposed using Principal Component Analysis in the first stage, and Discrete Cosine Transform in the second. Since compression parameters need to be adjusted to compress critical disturbance information with high fidelity, an automated but simple statistical change detection technique is proposed to identify disturbance data. Extensive verifications are performed using field data as well as simulated data to establish generality and superior performance of the method.